Robust Registration of Virtual Objects for Real-Time Augmented Reality

Augmented reality is a technology which allows 2D and 3D computer graphics to be accurately aligned or registered with scenes of the real-world in real-time. The potential uses of this technology are numerous, from architecture and medicine, to manufacturing and entertainment. Vision-based techniques which augment objects onto predetermined planar patterns are considered the most promising approach for achieving accurate registrations, but the majority of the proposed methods fail to provide any robustness to significant changes in pattern scale, orientation, or partial pattern occlusion. This thesis presents the design and implementation of a robust pattern-based augmentation system that addresses these problems, and analyzes its performance using standard consumer-level hardware. Known planar patterns are tracked in a real-time video feed, and virtual 2D and 3D objects are accurately augmented onto these patterns based on the plane's orientation. A method to achieve perspective-correct augmentations without the need for a manual camera calibration procedure is also described. iv Acknowledgments First, I would like to thank my thesis supervisors Gerhard Roth and Jit Bose. Without their support, this thesis would not have been possible. It's not often that the path to a master's thesis is laid out on a yellow brick road, but Gerhard has provided just that. Without his expert guidance and knowledge, his continuous flow of ideas and improvements, his quick turnaround in providing feedback on my writing, and the non-stop stream of technical papers that he would leave for me on my desk, I would not have been able to come this far this quickly. I am especially grateful for the encouragement he has given me throughout this masters experience, as well as the insights he has given me regarding what it takes to become a successful researcher. Additionally, his discussions and opinions regarding government and politics provided a refreshing break from my C++ code. I thank Jit for always being available to discuss thesis issues, course and degree requirements, and potential future PhD research topics and directions, even despite his busy schedule. I am most impressed by his humble demeanor, even though he is an expert in almost everything (including ping-pong and squash). I've always had a bad habit of attempting to finish things as late as possible, and the submission and defense of this thesis was no exception. Both Linda Pfeiffer and Nicki Enouy deserve a huge thank you for scheduling my thesis examination at the last minute, and making …